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1, INTRODUCTION 

Semantic labeling of digital images by classification is applied to content-based image retrieval and 
image annotation [1]. However, it is a difficult task to group images into semantic classes because of 
different colors and textures in various image classes [2]. In fact, today Vision and Pattern Recognition 
problems such as face recognition, fingerprinting identification, image categorization, and DNA sequencing 
often have an arbitrarily large number of properties to consider. To solve such complex problems using just 
one feature descriptor is a difficult task and feature fusion may become mandatory. Normal feature fusion is 
nearly effective for many problems. However, it can result in unexpected classification results when the 
different features are not properly combined. In addition, it has the drawback of increasing the dimensionality 
which might require more training data. 

To cope with these problems, this paper introduces an optimized fuzzy system, based on color and 
texture information. This approach is more flexible because of fuzzy concepts and it is more adequate to 
some problems than a naive method. Our Mamdani fuzzy inference system use three components of color 
space and two Zernike moment as inputs, where all these features are simply concatenated and fed to fuzzy 
classification algorithm and, three outputs shows the probability of belonging to three different image classes. 
Besides that, the presented technique is amenable to deal with much more digital image classes. 

Besides, introducing new approach, proposed method is applied in two different color spaces and 
obtained results are discussed. For more information, one may consult. Generally, the objectives of this study 
are: (1) to evaluate fuzzy inference system and Zernike moments for image classification aim, (11) to introduce 
new method of fuzzy system optimization based on genetic algorithm and (111) to compare two color spaces. 

In Section 2, Zernike Moments are discussed. Section 3 elaborates the proposed classification 
method. Results and conclusion are presented in Sections 4 and 5. 
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2. ZERNIKE MOMENTS 

Hu [3] showed the classical moment's application to two dimensional images in the early sixties. 
He tested their validity using a simple experiment to recognize written characters. Hu was only concerned 
with images without noise, but further work showed that traditional moment performance degrades where the 
view is occluded or noisy [4]. A survey of moment based techniques with respect to computer application 
details many of the current techniques regarding representation and recognition [5]. 

Zernike moments are a class of orthogonal moments and have been shown effective in terms of 
image representation. Zernike moments can be easily constructed to an arbitrary order. Although higher order 
moments carry more fine details of an image, they are also more susceptible to noise. Therefore, we have 
experimented with different orders of Zernike moments to determine the optimal order for our problem. 
The Zernike polynomials are a set of complex, orthogonal polynomials defined over the interior of a unit 
circle x2+y2=1 [6]. 
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where, n is a non-negative integer, m is an integer such that n—|m| is even and |m|Sh, p= 
and @=tan-1(y/x). 
Projecting the image function onto the basis set, the Zernike moment of order n with repetition m 1s: 
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As the Zernike moments are calculated using the radial polynomials, they have inherent rotation 
invariant property. It has been shown in [7] that the Zernike moments on a rotated image differ from those of 
the original un-rotated image in phase shifts, but not in magnitudes. Therefore [Anml can be used as a 
rotation invariant feature of the image function. Since An,—m= Anm, and therefore [An,—ml=lAnml, we will 
use only |[Anml for features. Since I[AQOI and IA111 are the same for all of the normalized symbols, they will 
not be used in the feature set. Therefore the extracted features of the order n start from the second order 
moments up to the nth order moments. 


3. PROPOSED ALGORITHM 

Moment descriptors have been studied for image recognition and computer vision since the 1960s. 
Teague first introduced the use of Zernike moments to overcome the shortcomings of information 
redundancy present in the popular geometric moments. Here, we use two order of Zernike moments beside 
color information to materialize a robust semantic color image classification. Better evaluation and 
comparing, two empirical and optimized systems are designed for HSV, color space. Details of learning and 
designing process are presented in following sections. 


3.1 Empirically Design Classification System 

As group images into semantic classes is complex and should be applicable for digital images in 
various lighting / resolution / size and environmental conditions, using fuzzy inference system is a proper 
offer to overcome this complexity and improve system flexibility. In designing FIS three major steps should 
be followed: 
a) The number of inputs and designing their MFs 
b) The number of outputs and designing their MFs 
c) Defining rules to connect inputs and outputs 

Five inputs are considered for FIS. Three of them are three color spaces components. These inputs 
provides color and intensity information of digital color image. To increase system accuracy a Zernike 
moments descriptor information is applied as a two other inputs. These inputs add image texture properties to 
our system. Two dimension images are needed to calculate Zernike moments. We use intensity value image 
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of color image to this aim. Figure 1 shows an RGB, HSV and obtained intensity images. The center of image 
1s considered as a center of unit circle and image is mapping inside it. Using (3) Zernike moments could be 
calculated. To have both low and high moments information, we use 4th and 40th magnitude 
(at 8=30°) moments as fourth and fifth inputs, respectively. 

The number of outputs should be equal to image classes. In this work we form a database contains 
three different classes. They include: Face, See and Mountains images. So, we have three outputs where each 
of them reveals the probability of belonging to special class. Some examples of our database images are 
shown in Figure 2. 





(b) 


Figure 1. (a) RGB image, (b) HSV image, (c) Intensity image 





(c) 


Figure 2. Sample images of collected database, (a) face, (b) Sea and (c) Mountain classes 
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Mamdani fuzzy inference system is applied to make decision. Both inputs and outputs should be 
interpreted by appropriate MFs. In this stage, after various investigations, they have achieved using 
experimental knowledge. 30 rules are defined and centroid method [8] is utilized to have crisp outputs. 

This system uses a sample color image as input and there are three outputs show the probability of 
belonging to three different image classes. The image is labelled as a class which reach higher probability. 
If all outputs be less than 50%, the input image would belong to none of considered image classes. 
Figure 3 show inputs and outputs MEFs. 
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Figure 3. (a)-(e) inputs and (f)-(h) outputs MFs in HSV color space 
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3.2 Optimization by GA 
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Fuzzy inference system is reliable method. Steel, it is often difficult for a human expert to define the 
fuzzy sets and fuzzy rules. GAs has proven to be a useful method to optimize membership functions of fuzzy 


sets [9]. GA parameters are selected as follows: 


Initial population = 100 
Crossover coefficients= 0.7 


Mutation coefficient (mutation is done in an un-uniform) = 0.05 


Migration coefficient = 0.15 


Our empirical knowledge is utilized to reduce the searching space and expedite the process. 
The MFs' shapes are chosen according to previous designed system and the parameters of MFs are utilized as 
the inputs of the GA, whose fitness function attempts to maximize the output probability for the class that 


input image belongs to it. Figure 4 illustrate optimized MEFs. 
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Figure 4. (a)-(e) inputs and (f)-(h) outputs optimised MFs in HSV color space 


4. RESULTS 

To evaluate designed systems performance, we gather a proper image database. This database 
contains 40 face images, 50 sea images, 50 mountains images and 50 various images that they do not lie in 
three previous groups. Our images are from 120x132 to 560x350 in size. Different lightening condition and 
rotated images are considered in this dataset. Both empirically design and optimised systems, called System 1 
and System 2 respectively, are applied and achieved results are presented in Table 1. 


Table 1. Obtained Classification Rates (%) 


System | System 2 
Face Sea Mountain Total Face Sea Mountain Total 
Rate 90 95 90 93.05 92.5 97.5 95 95.25 


With investigating obtained results three image classes two designed system could be compared. 
In all cases sea class shows the best result. In the images of this group both color and texture information are 
approximately constant. So, based on these properties, it 1s expectable that we have the most classification 
rate. Although mountains images have similar color, their texture differs from each other. As face images 
contain wide range of skin color and various textures, because of different face expression, decrease in 
classification rate is unavoidable. Considering face images condition, obtained results are still acceptable. 


5. CONCLUSION 

This paper has offered a new semantic image classifier. Beside color information the image texture 
properties were applied by computing Zernike moments. All information was used as inputs of fuzzy 
inference system for making decision and classification. In addition, after empirically system design, 
all membership functions are optimized by genetic algorithm and best shape of them were achieved. 
Obtained results proved much better performance for optimized system. Suggested method to optimize fuzzy 


system 1s a novel way, could be applied to design membership functions in any arbitrary fuzzy system, 
generally [10]-[12]. 
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